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Abstract. In this paper, we present the first reduced basis method well-suited for the collocation 
framework. Two fundamentally different algorithms are presented: the so-called Least Squares 
Reduced Collocation Method (LSRCM) and Empirical Reduced Collocation Method (ERCM). This 
work provides a reduced basis strategy to practitioners who prefer a collocation, rather than Galcrkin, 
approach. Furthermore, the empirical reduced collocation method eliminates a potentially costly 
online procedure that is needed for non-affinc problems with Galerkin approach. Numerical results 
demonstrate the high efficiency and accuracy of the reduced collocation methods, which match or 
exceed that of the traditional reduced basis method in the Galerkin framework. 
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1. Introduction. Reduced basis methods (RBM) [2J H US QB EH 13 were de- 
veloped for scenarios that require a large number of numerical solutions to a parametrized| 
partial differential equation in a fast/real-time fashion. Examples of such situa- 
tions include simulation-based design, parameter optimization, optimal control, multi- 
model/scale simulation etc. In these situations, we are willing to expend significant 
computational time to pre-compute data that can be later used to compute accurate 
solution in real-time. 

The RBM splits the solution procedure into two parts: an offline part where the 
parameter dependence is examined and a greedy algorithm is utilized to judiciously 
select N parameter values for pre-computation; and an online part when the solution 
for any new parameter is efficiently computed based on these N basis functions. 

The motivation behind the RBM is the recognition that parameter-induced so- 
lution manifolds can be well approximated by finite-dimensional spaces. For linear 
affinc problems, RBM can improve efficiency by several orders of magnitude. For 
nonlinear or 11011-afhne problems, there are remedies which allow the RBM methods 
to be used efficiently [3J |H1 [TS] . The offline selection of the N parameter values for 
the pre-computcd bases is enabled by a rigorous a posteriori error estimate which 
guarantees the accuracy of the solution. Exponential convergence with respect to N 
has been commonly observed, see [TjU [7] and the reference therein. Theoretically, a 
priori convergence is confirmed for a one dimensional parametric problem [13] . More 
recently, exponential convergence of the greedy algorithm for continuous and coercive 
problems with parameters in any dimension has been established in [5] , and improved 
in @]. 

The development and analysis of RBM has been previously carried out in the 
Galerkin framework. That is, the truth approximations (the numerical approximation 
from a presumably very accurate numerical scheme) are obtained from a (Galerkin) 
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finite clement method, and the reduced basis solution is sought as a Galcrkin projec- 
tion onto a low dimensional space. However, to date RBM have not been developed, 
applied, or analyzed in the context of collocation methods. While Galcrkin methods 
are derived by requiring that the projection of the residual onto a prescribed space is 
zero, collocation methods require the residual to be zero at some pre-determined col- 
location points. Compared to collocation methods, Galerkin methods have a weaker 
regularity requirement on the solution. For example, for second-order problems, col- 
location methods require the solution to be at least H 2 over the domain ft, while 
Galerkin methods only require solutions in due to the adoption of the weak 

formulation. Unlike collocation methods, Galerkin methods do not require a tenso- 
rial grid and handle curved boundaries with ease. On the other hand, collocation 
methods are particularly attractive for their ease of implementation, particularly for 
time-dependent nonlinear problems [2TJ [20] [10] . 

In this paper, we develop the RBM idea for collocation methods. Given a highly 
accurate collocation method that is used as the truth solver for the parametric prob- 
lem, we wish to study the performance of the system under variation of certain pa- 
rameters using a collocation-based RBM. That is, the new method uses collocation 
for both the truth solver and the online reduced solver. 

The paper is organized as follows. In Section [2] we present two approaches to 
collocation RBM. The first one utilizes a least squares approach. The second one 
relies on a projection of the fine collocation grid problem onto a (carefully-chosen) 
coarse collocation grid. Theoretical analysis and discussions on the offline-online 
decomposition are provided in Section [3] Numerical results are shown in Section 21 
Finally, some concluding remarks and future directions are in Section [5] 

2. The Algorithms. We begin with a parametrized partial differential equation 
of the form 

L(^) Ufi (x) = f(x; n), x 6 n C R n (2.1) 

with appropriate boundary conditions. We are interested in the solutions of the 
differential equation over a range of parameter values /i, where \x = {\x\ , . . . , fid) £ 23, a 
prescribed d-dimcnsional real parameter domain. The parameters can be, for example, 
heat conductivity, wave speed, angular frequency, or geometrical configurations etc. 

In this work, we assume that the operator is linear and affine with respect to 
functions of fi. That is, L(/z) can be written as a linear combination of parameter- 
dependent coefficients and parameter-independent operators: 

Qa 

L( M )=^»)L 9 . ( 2 - 2 ) 

9=1 

We make a similar assumption for /: 

Qf 

f{x; t i)=J24(»)f<i( x )- (2-3) 

9=1 

In the Galerkin framework, these are common assumptions in the reduced basis liter- 
ature [IH] . There are remedies available when the parameter-dependence is not affine 

El Bang. 
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For any value of the parameter /i, we can approximate the solution to this equation 
using a collocation approach: we define a discrete differentiation operator Lj^/z) so 
that the approximate solution satisfies the equation 

L ys ( f i) U K(x j ) = f(x j ; f i), (2.4) 

exactly on a given set of 3\f collocation points — {xj}j =1 , usually taken as a 
tensor product of N x collocation points for each dimension. Obviously, for £1 C 
W 1 we have N = N™. We assume that the scheme (|2.4[) produces highly accurate 
numerical solutions to the problem (|2.1j) . We refer to the solution as the 
"truth approximation" . 

Although solving (|2.4p gives highly accurate approximations, it is prohibitively 
expensive and time-consuming to repeat for a very large number of parameter values (i. 
The reduced basis method allows for highly accurate solutions to be computed quickly 
and efficiently when needed (the "online" computation) based on a set of possibly 
expensive offline computations. The idea of the reduced basis method is that we first 
pre-compute the truth approximations for a set of N << N well-chosen parameter 
values {/i 1 , /i 2 , [j, N } by solving (|2.4[) with the corresponding parameter value. 
Then when the solution for any parameter value fi* in the (prescribed) parameter 
domain T) is needed, instead of solving for the (usually expensive) truth approximation 
u^* , we combine , u^ 2 , ■ • ■ , u^ N in some way to produce a surrogate solution : 



N 

3=1 



Thus, the design of the reduced basis method requires two components: 

1. Offline: how to select the pre-computed basis. 

2. Online: how to combine the pre-computed basis functions to produce the 
surrogate solution. 

In the following sections, we describe two variants of the reduced collocation algorithm. 
We first explain our approaches for the online computation of the surrogate solution 
from the pre-computed reduced basis in Section [2. 1[ and then the related question of 
the selection of the reduced basis in Section [2~2l 

2.1. Online algorithms. For the surrogate solution uL» to approximate the 

truth approximation u^* reasonably well, we require that uj^ provides, in some sense, 
a good approximation to the solution of the discrctized differential equation 

l ^(m*) I E c j u ^ I ~ /(^m*)- 

By exploiting the linearity of the operator we observe that our task is to find coeffi- 
cients Cj(fi*) so that the residual 

N 
3=1 

is small. 
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In the Galcrkin framework [191 [7] , the coefficients are found by requiring that the 
L 2 -projection of this residual onto the reduced space is zero. For the collocation case, 
the system of equations wc wish to solve is 

N 

J2cj(»*)^(»*K j (x k ) = f(x k ; f i*) k = l,...,X. (2.5) 

However, this system is over-determined: we have only N unknowns, but Tsf >> TV 
equations. To approximate the solution to this system, our task is to identify an 
appropriate operator ? such that the following holds 

p =3>(/(*;m*))- (2-6) 



By considering two different ways to choose the operator 7 in Equation (|2.6p . wc 
propose two approaches for finding the coefficients of the reduced basis solutions. 
These two approaches are the least squares approach and the reduced collocation 
method. 

Least-squares approach. Our first approach is a very standard approach to ap- 
proximating the solution to an over-determined system. We determine the coefficients 

f I 

N Si 



by satisfying the equation (|2.6p in a least squares sense. Given {w^i, u^ 2 , • • ■ , u ^n}, 



wc define, for any /i*, an 3\f x N matrix 



and vector of length ]\f 

f? = f{x jiff) x 3 eC*, 

and solve the least squares problem 

A^(M*)A JV (/x*)c = A^(/i*)f N (2.7) 
to obtain c= (ci(^*), c 2 (/i*), . . . , c N (fi*)) T . 

Reduced Collocation approach. A more natural approach from the collocation 
point-of-view is to determine the coefficients c by enforcing (|2.6[) at a reduced set of 
collocation points C^. In other words, we solve 

TV 

]T Cj (M*X (Ma*>£) = f(x; ft), for x e C£ (2.8) 



- 



where I^f is the interpolation operator for functions defined in the W-dimensional 
space corresponding to the fine-domain collocation points at the smaller reduced 
set of collocation points C^. In other words, we define the N vectors of length vV by 
their elements 

(vO = (L*(,Ot#) and (f N ) k = f(x k ) for x k G C# 

and solve the N x N system of equations 

N 

5^c,-(/i*)vj. =f Jv . (2.9) 



The choice of reduced collocation points can be any set of N points in the compu- 
tational domain. Later we will demonstrate how this set of points can be determined, 
together with the choice of basis functions, through the greedy algorithm (Algorithm 
[2]). Although the coefficients are computed based on collocation on a coarser mesh, 
the quality of the reduced solution is not degraded since the differentiations are per- 
formed first, by the highly accurate operator L^(^*) whose accuracy is dependent on 
N. This differentiation is then followed by an interpolation at the set of N points. 

Once the coefficients {cj (//*)} are determined, whether by the least squares ap- 
proach or the reduced collocation approach, we define the reduced basis solution 



jv 

3=1 



In both the least squares and reduced collocation cases, the coefficients are determined 
by solving an TV x N system. Furthermore, due to the affine assumption on the 
operator, the online cost of assembling the system is also independent of N (as will be 
seen in Section [3]). Thus, the online component requires only modest computational 
cost because N is not large. 

2.2. The pre-computation stage. Appropriate selection of the basis functions 
is a major determinant of how well the reduced basis method will work. The pre- 
computation and selection of basis solutions may be expensive and time-consuming, 
but this cost is acceptable because it is offline and done once-for-all. Once the re- 
duced basis solutions are computed and selected, the online component can proceed 
efficiently, as described above. 

In this section we describe algorithms for choosing the reduced basis set {u^i , . . . , u^ N }.l 
The selection of the reduced basis is performed in order to enable us to certify the 
accuracy of the reduced solution. The critical piece of information is that given a pre- 
computed reduced basis set {u^i , ■ • ■ , } we can compute an upper bound Aj(/z) for 

(i) 

the error of the reduced solution it// for any parameter fjb. This upper bound is given 

by 

AM = ll^-M/O^II* (2 . 10) 

a//3lb(m) 

where (3lb(h) is the lower bound for the smallest eigenvalue of hjj(/i) T Ly{(fi). This 
upper bound is enabled by the a posteriori error estimate which will be proved in 
Section I5TT1 In the following, we present the greedy algorithms used for the selection 
of the pre-computcd basis for the least squares and the reduced collocation approaches. 

2.2.1. Least Squares Reduced Collocation Method (LSRCM). The idea 
behind the greedy algorithm is to discretize the parameter space, and scan the dis- 
crete parameter space to select the best reduced solution space. To do this, we first 
randomly select one parameter and call it fj}, and compute the associated highly ac- 
curate solution u„i. Next, we scan the entire discrete parameter space and for each 

parameter in this space compute its least squares reduced basis approximation Up . 
We now compute the error estimator Ai(fi). The next parameter value we select, 
[i 2 , is the one corresponding to the largest error estimator. We then compute the 
highly accurate solution u^ 2 , and thus have a new basis set consisting of two elements 



Algorithm 1 Least Squares Reduced Collocation Method (LSRCM): Offline Proce- 
dure 

1. Discretize the parameter domain 2) by S, and denote the center of CD by /i c . 

2. Randomly select /i 1 and solve L^^ 1 ) u^ 1 (x) — f(x; /i 1 ) for x £ C . 

3. For i = 2, . . . , N do 

1) . Form Aj_ a = (l^ , L N , . . . , L N ■ 

2) . For all /i 6 H, solve A^_j Aj_i c = A^_ x f N to obtain u^ -1 ^ = X^-=i c j u ^j- 

3) . For all (U G S, calculate Ai_i(/x). 

4) . Set /i* = argmaXfj, A,_i(/x). 

5) . Solve L^^Or) = /(x;^) for a; £ C K 

4. Apply a modified Gram-Schmidt transformation, with inner product defined 
by (it,i>) = (Lj^(/i c )ii,Lj^(/i c )i;) i 2 ( - ), on the basis , w^ 2 , • ■ • , u^ N j to obtain a 
more stable basis ■ ■ ■ , for the least squares reduced collocation method. 



This process is repeated until the maximum of the error estimators is sufficiently 
small. At every step we select the parameter which is approximated most badly by 
the current solution space, with the goal being that in this way we select a solution 
space that will approximate any parameter reasonably well. The detailed algorithm is 
provided in Algorithm [TJ To ensure the reduced system is well-conditioned, we apply 
the modified Gram-Schmidt transformation with weighted inner product. 

2.2.2. Empirical Reduced Collocation Method (ERCM). The least squares| 
approach above can not be immediately adapted to the collocation case because col- 
location requires the same number of collocation points as basis functions. Thus we 
face an additional problem of having to choose an appropriate set of collocation points 
Cft at which to enforce the PDE. In fact, the choice of the reduced set of collocation 
points is crucial for the accuracy of the algorithm. For example, as we will show in 
the numerical example in Section 01 naively using the coarse Chebyshev grid does 
not yield an accurate result. In the following, we propose the Empirical Reduced 
Collocation Method for choosing the basis functions and reduced collocation points. 

The idea behind the empirical reduced collocation method is similar to the greedy 
algorithm used quite often by the reduced basis method and it has the same structure 
as the Empirical Interpolation Method [3l[9j[T5]. We build the set of collocation points 
hierarchically with the each point chosen from the set of candidate points X (taken to 
be the set of fine collocation grid C ). We begin by picking a parameter randomly 
and computing the corresponding basis function it^, and selecting the collocation 
point x\ at which the absolute value of the basis function attains its maximum. (We 
note that it is also possible to choose the collocation point which maximizes one of 
the partial derivative of the basis function however, this choice did not perform well 
in numerical tests.) Now we can say we have a set of basis functions and a 

set of collocation points {xj} l ~} 1 . We compute the reduced basis solution X ' for all 
fi in the discretized parameter domain, and the associated error estimator Ai_i(/i). 
To get the next basis function, we find the parameter value // at which the error 
estimator is maximized, and we compute the highly accurate solution . To ensure 
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Algorithm 2 Empirical Reduced Collocation Method (ERCM): Offline Procedure 
1. Randomly select \i x and solve L^jU 1 ) %P\ (x) — /(x;^ 1 ), and let x 1 - 



argmax x ^x 



2. For i = 2, . . . , N do 

1) . Let C^ 1 = {x 1 ,...,!*- 1 }. 

2) . For all /x 6 S, solve c j P £r (Mm)^) = f(x;n) for z e C l R x to 

obtain = 2^- =1 c j u ^ ■ 

3) . For all 6 S, calculate A.j_i(/x). 

4) . Set //' = argmax^eE. Aj_i(^). 

5) . Solve L^(^) t#(z) =f(x; f x i ). 

6) . Find ai, . . . , a,_i such that, if we define ^ = — Y^j=i a j Zfi wc nave 

i A nli.r., 1 i I. 

7) . Set x % = argmaXx \Zi\ and ^ = prfa^ ■ 

8) . Apply modified Gram-Schmidt transformation on ■ ■ ■ 

3. Set the reduced set of collocation points = {x 1 , x 2 7 . . . ,x N } and use the set 
{£i f i £2^ • ■ • j as the basis for the reduced collocation method. 



well-conditioning of the process, we orthonormalize the basis functions in the sense 
that if we define = ^(x 1 ), then the matrix B N is lower triangular with unit 

diagonal. We now obtain the set of orthonormalized basis functions {£x f , ■ • ■ tCn}- 
Finally, the ith collocation point is chosen to be that at which the absolute value of 
the basis function is maximized. Repeatedly following this procedure, given in 
Algorithm [3J we obtain the set of orthonormalized basis functions ...,£$} and 
the reduced set of collocation points C R = {x 1 , x 2 , . . . , x N } that will be used to find 
the surrogate solution. 

Remark The choice of collocation points described above is different from the 
"best point" and "hierarchical point" approximations described in |15j . In our ap- 
proach, we used the rather ad-hoc - and inexpensive - approach of choosing a col- 
location point which maximizes the corresponding basis function. The "best point" 
and "hierarchical point" approaches choose the interpolation points by minimizing, 
in some sense, the difference between the interpolation and projection coefficients. 
However, we compared these approaches in numerical tests based on the problems 
considered in Section 4, and the sophisticated "best point" and "hierarchical point" 
approaches performed no better than the simple algorithm above in terms of size 
of errors and rate of convergence of the reduced collocation solution to the truth 
approximation. 

3. Analysis of the Reduced Collocation Method. In this section, we pro- 
vide some analysis of the proposed algorithms and some details for the offline-online 
decomposition that is crucial to the traditional tremendous speedup of reduced basis 
method. 

3.1. A Posteriori Error Estimate. The essential ingredient of the accuracy of 
the reduced collocation method is the upper bound which is used for error estimation. 
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In this section, we state and prove the theorem relating to this error estimator. 

Before we state our theorem, we must assume that we have a lower bound /3lb(/x) 
for the smallest eigenvalue of Lj^/z^Lj^/z), 

at \ ■ t> T L^(M) T L^(/i)^ 

p(H)=mm = . (6.1) 

v V V 

Theorem 3.1. For any \i, suppose iff is the truth approximation solving (|2.4[) 
and is the reduced basis solution solving (|2.8p or (|2.7p . we define 

A M = r^M^ (3.2) 

Then we have \\u^ — u^^H^a < Apf(fi). 

Proof. We have the following error equation on the N-dependent fine domain 
collocation grid thanks to the equation satisfied by the truth approximation (|2.4[) : 

M/x) («* -«*)=/- L N (^)<. 

Taking the discrete £ 2 -norm and using basic properties of eigenvalues gives 

|/-Lx(m)<||^ 



IK-<||/2< 



□ 

This a posteriori error estimate is used repeatedly in the greedy algorithm to 

determine the reduced basis set I xff 1 , u^ 2 , • ■ • , > . In addition, the a posteriori 

^ f* /* m j 

error estimate also serves the role of certifying the accuracy of the reduced solution: 
given a tolerance £± \, it is trivial to modify the algorithms so that they will find 

an appropriate number N and a corresponding set < u„i , u„ 2 , ■ ■ ■ , u n > such that the 

^ A* p M J 

resulting reduced solver will have error below e^ j for [i £ S. While this is not enough 
to guarantee accuracy for any /i G ID, it suggests that if 3 is a discretization that 
represents T> well, the reduced basis method will work well for any \x £ D. 

3.2. Offline-Online decomposition. As is well-known [19], the tremendous 
speedup of the reduced basis method comes from the decomposition of the computa- 
tion into two-stages, called offline and online stages. The offline stage is done once 
for all and is N-dependent (thus expensive). The online stage should be independent 
of N thus economical and can be afforded for every new value of the parameter /z in 
the prescribed domain D. 

Thus the key to the efficiency of the reduced collocation method is the ability to 
decompose the computation into an offline component and an efficient online com- 
ponent. In this section, we describe how a complete offline-online decomposition is 
achieved for the two algorithms. We also include an estimate of the computational 
complexity, which makes evident the dependence of the computational cost on N in 
the offline computation and its independence in the online computation. 

3.2.1. Least Squares. We begin with the least-squares equation (|2.7I) . 
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Invoking the affine assumption for L (Equation (|2.2[l ) and / (Equation (J23J)) gives 

Qa Qa 



iJi A N 



)« = ( L * <<) <0 = E E < (^) ( L 91 <«) ( L *> 



91=1 92 = 1 



91 = 1 92 = 1 



Hence, the decomposition and operation count can be summarized as follows 

Offline Calculate (h Ql ufy T (L 92 ) and (h q ufy ? f£ for i, j G {1, N}, with 

complexity of order N 2 Q 2 a JS 2 + NQ a Q f K. 
Online Form the N x N matrix Ajy Ajv and Nxl vector (Ajy) T f N for any [i* G T> and 

solve the reduced N x N system for coefficients Cj l|2.7[) . Online complexity 

is of order iV 2 Q 2 + Ar3 + Q a Q f N. 

3.2.2. Empirical Collocation. Here, we demonstrate the offline-online decom- 
position for the reduced collocation approach. The reduced equation in this case is 

jv 

]T Cj F% (l*(M>£) = f(x; //)• for x G C% (3.3) 



=i 



which becomes 

N Q a Qf 

5>$>£oop# =E a 9(M*)/9W 

3=1 9=1 9=1 

with the affine assumptions (|2.2[) and (|2.3p . 

This means that, given {/x 1 , /x 2 , . . . , fi N } and the set of N reduced collocation 
points Cft, the splitting of the computation is done as follows: 

Offline Calculate L g it^ , their P^f projections, and f q (x) for x G Cjj . The complexity 
is of order A^ 2 Q a K 3 (see Section 14.1.11 for the complexity for the projection 

K)- 

Online Form a^(fi*)¥^ (h q u^j^j for any j and q, evaluate a£(/i*) and form a£(/x*)/ g (x)| 

at the reduced set of collocation points Cj(, and finally solve the reduced 
NxN system for Cj's (|2.8jl . Online complexity is of the order Q a N 2 +N 3 +Q /. 

3.3. Efficiently computing the Error Estimator. Although we are primarily 
interested in minimizing the online cost of computation, it is also advantageous to be 
able to efficiently compute the offline component of the reduced collocation method. In 
particular, the greedy algorithm requires repeated computations of the error estimator 
Aj(/x) for i G {1, . . . , N} and any fx G 3. To make this practical, as we select more and 
more bases and i goes from 1 to N, we can reuse previously computed components 
of the error estimator. This can be achieved in essentially the same fashion as in the 
Galcrkin framework. Indeed, we have, 

||f N - M M ) M «|| 2 2 = (f N - M M ) u «) T (f* - 



The resulting three terms after expansion are 

eUfi) := (L^( m ) u W) t (Lh(m)^), 

They can be handled efficiently in the same fashion. To do that, we invoke the affinc 
assumptions (|2.2I) - (|2.3|) and the expansion of the reduced solution u$ = 2}=i c i(A i ) u ^fj | 
to obtain 

Qf 

4 (A 1 ) = E a L M fq 3 /</4 

93,94 = 1 



i(A*)= E c ^) c J2^)<(m)<(^) (<) L^Lo.t 



3\f 

92 "j 2 

31 ,32 = 1 51,52 = 1 



Q a 0/ i 

4oo = E E E ^(mX^)^^)/^^^ 

91 = 1 g 3 =l = l 

The Offline-Online decomposition of these terms and their computational complexities 
are as follows. 
Offline Calculate 

fq 3 fq4i 

j q3 iu qi u h 

for qi,q 2 € {1, . . . ,Q a }, qs, 94 G {1, . . . , Qf} and ji, j 2 e {1, . . . , i}. The 
cost is of order Q 2 f N + N 2 N 2 + Q a Q f NJJ 2 . 
Online Evaluate the coefficients 

Cji(^)c j2 (Ai)a^(^)a^ 2 (Ai), 

and form 

4( M ) := (L^)^) T (L N ( M ) U «), 

4(/z) := (i*) T (M/^>). 

The online computation has complexity of order Q"j + N 2 Q 2 + Q a QfN. 

3.4. Comparison with the Galerkin RBM. In this section, we show a par- 
ticular advantage of the proposed Empirical Reduced Collocation Method over the 
traditional reduced basis method in the Galerkin framework. When the operator is 
non-affine, that is, we have instead of (|2.2p 



Qa 

L(/i) =E a 9^M)L 9 , (3.4) 

9=1 
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The Galcrkin approach has to use the Empirical Interpolation Method [3] |Hj to achieve 
the offline-online decomposition and the traditional speedup. In fact, Og(x, //) has to 
be approximated by the affine expansion 

M q 

<(x, M )= ]T C(mK//,„>), (3-5) 

so that (liquet , u^j & q a j f m (x))n ar e computed offline for all i, j, q, m. During the online 
stage for any given fx, (j) q m {fi) are obtained and J2q=i Emli^t^JS'^mWln are 
formed. Obviously, the online performance is dependent on ^2q=i Mq- The prolifera- 
tion from Q a to Ylq=i M q adversely affects the online performance of the reduced basis 
method and limits its practical scope. This is particularly the case for geometrically 
complex problems with parameters describing the geometry [5J [T71 [Tj|] : Y^j=i M q can 
be one to two magnitudes larger than Q a . The online efficiency is thus significantly 
worse than the affine problems. 

However, this significant barrier does not exist for the proposed empirical reduced 
collocation method. Since to form the online solver we only need to evaluate (x, /i*) 

for x £ Cft. This can be done without the expansion (|3.5|) . Note that P^J (hqU^^j is 
readily available from the offline calculation. 

Unfortunately, this advantage of the empirical reduced collocation method over 
the Galerkin framework does not translate to the least squares reduced collocation 
method: when a q (fi) = a q (x,[i), we need to perform the expansion (|3.5[) to have the 
online procedure of forming NxN matrix A^ A^r independent of 3\f. The fundamental 
reason is that least squares is intrinsically a projection method and thus our least 
squares reduced collocation method is closely related to the Galerkin RBM framework. 

4. Numerical Results. In this section, we consider a couple of two-dimensional 
diffusion- type test problems similar to those used in [I8j [19] to show the accuracy and 
efficiency of the proposed methods: 

1. Diffusion 

(1 + mx)u xx + (1 + H2V)uy V = e 4xy (4.1) 

on fl = [— 1, 1] x [—1,1] with zero Dirichlct boundary condition. 

2. Anisotropic wavespeed simulation 

- u xx - muyy - fi2U = -10 sin(8 x (y — 1)) (4.2) 

on Q, = [—1,1] x [—1,1] with zero Dirichlet boundary condition. 
Our truth approximations are generated by a spectral Chebyshev collocation 
method [HUTU]. For C 7 ^ and for X, we use the Chebyshev grid based on ~N X points in 
each direction with = N. We consider the parameter domain D for (fii, /12) to be 
[— 0.99, 0.99] 2 and [0.1,4] x [0,2] respectively for the two test problems. For 5, they 
are discretized uniformly by 64 x 64 and 128 x 64 Cartesian grids. For the purpose of 
reproducible research, the code has been posted online [TJ. 

4.1. Preliminaries. 

4.1.1. Computation of P^f. For the empirical reduced collocation method, we 
need the fine-to-coarse projection P-JJ. We begin with a set of Chebyshev points in 
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one dimension Xj = cos(^). Given a vector of function values w(xj), we define the 
function w(x) by the Chebyshev expansion |10j 

N 

w(x) =J2^kT k (x). (4.3) 

k=0 

where 

ak = ;jjr ^w(xj)cos(k arccosfo)) = ^ ^ w ( x i) cos ("^fj ■ ( 4 - 4 ) 
Here. 

1 1 otherwise 
This definition relies on the fact that the Chebyshev polynomial is 

Tfe(x) = cos(fcarccos(x)), 

so that 

W ( X j) =J2 a k COS(^). 

Now, if we wish to evaluate the function value of w(x) at any set of points {xi}, 
we simply plug those points into the Chebyshev expansion 

N 

w(x e ) = ^2 a k T k (x e ). (4.5) 

fc=0 

In particular, the calculation of P^w is done by evaluation at the reduced set of TV 
points Cft. For two or three space dimensions, (|4.4[) becomes a double or triple sum 
over the points in each dimension, while (|4.5|) contains only the reduced collocation 
points. Thus, computational complexity to evaluate (j4.5[) for £ 6 {1, ...,JV} is of 
order NN 2 , where 3\T is the total number of points in the fine mesh and N is the 
number of points in the reduced collocation grid. Unfortunately, N is a product of 
the number of points in each dimension, which of course grows exponentially. 

4.1.2. Results of the fine solver and setup for the reduced solvers. Be- 
fore we begin with the reduced basis solver, we must quantify the accuracy of the 
fine-domain solver, which produces the truth approximations. Reference solutions 
computed by Chebyshev collocation method on a 81 x 81 grid for [i\ = 1 and fj,2 = 0.5 
are plotted in Figure 14.11 We also compute the truth solutions on a N x x N x grid 
for J{ x changing from 20 to 77 and evaluate the L 2 and L°° errors. Exponential 
convergence of the truth approximation with respect to 3\f is shown by Figure 14.21 as 
expected. 

In the greedy algorithm, we required a lower bound on the eigenvalue of the 
operator. For the purposes of this work, we simply calculate the smallest eigenvalue 
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Reference solution with N = 80 



Reference solution with N = 80 




Fig. 4.1. The truth approximations for diffusion (left) and anisotropic wavespeed simulation 
(right) for = 1 and /i2 = 0.5 computed on a 81 X 81 Chebyshev grid. 




Fig. 4.2. The accuracy of truth approximations for diffusion (left) and anisotropic wavespeed 
simulation (right) for = 1 and fi2 = 0.5 with reference solution being computed on a 81 X 81 
Chebyshev grid. 



for each [i S 3 and use it as the lower bound /3lb(/u). That is, the error estimator for 
the reduced basis solution based on a reduced basis set {w^i , . . . , } is given by 



There are more efficient ways |l2J|6j[TT]. However, algorithm design and implementa- 
tion of how to efficiently calculate /3lb(h) is not an emphasis of this paper. Instead, 
we are concentrating on the design of the overall reduced basis method in the col- 
location framework. The eigenvalues /?(//) are plotted in Figure |4~51 for the two test 
problems. The first problem becomes close to being degenerate at the four corners of 
the parameter domain. 

4.2. Results of the reduced solver: Anisotropic wavespeed simulation. 

In this section, we present the results of the two reduced collocation methods applied 
to the anisotropic wavespeed simulation. 

We first perform the offline pre-computation of the reduced basis and collocation 
points. The 17 parameter values are chosen from S by Algorithms [T] and [2] are shown 
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Fig. 4.3. The eigenvalues for the diffusion problem (left) and Anisotropic Wavespeed Simulation 
(right). 
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Fig. 4.4. Top: The reduced collocation points selected by the ERCM for Anisotropic wavespeed 
simulation, and the corresponding convergence plot. Bottom: The result of a (pre- determined) coarse 
Chebyshev grid was used. 



in Figure I4.5I with larger marker indicating the earlier that parameter picked. The 
reduced set of collocation points for ERCM is shown in Figure POI (top left). C l R 
contains the i points in the computational domain Q = [—1, l] 2 corresponding to the 
i largest markers. 

Next, we solve for the reduced basis solution for a randomly selected set of 2, 097 
parameter values in D and compute the maximum, median, and minimum errors 
for each selected value between the reduced solution and the truth approximations. 
These, together with the maximum of the error estimate are plotted in Figure 14.61 

li 




2 Ml 2.5 



Fig. 4.5. The parameters picked by the greedy algorithm for pre- computation for the anisotropic 
wavespeed simulation. Top: Least Squares approach, bottom: Empirical Reduced Collocation Method. 



We clearly see exponential convergence in all cases by both methods. We compare 
Figure 14.21 and Figure 14.61 to draw the following remarkable conclusion: In the worst 
case scenario, using the empirical reduced collocation method on a 16 = 4 x 4 grid 
can produce solution having comparable accuracy of the truth approximation on a 
grid 50 x 50. We also see that, on average, the two proposed algorithms have similar 
accuracy. But, over a wide range of parameter values, the least squares approach seems 
to be more stable (the errors have smaller variance). Moreover, we show in Figure POl 
how the choice of the reduced set of collocation points affects the accuracy of the 
reduced collocation method: our proposed method generates the reduced grid on the 
top left. The best case scenario for a randomly selected set of 2, 097 parameter values 
are shown on the top right. On the other hand, if we naively use a coarse Chebyshev 
grid as the (shown bottom left), the best case convergence plot is on the bottom 
right: the approximation is very bad with the system becoming numerically singular 
for N > 10. 

4.3. Results of the reduced solver: Diffusion. We set 2) = [-0.99, 0.99] 2 , 
apply the empirical and least squares reduced collocation methods to the diffusion 
problem and present the results in this section. 

We pick 50 parameter values in CD according to the greedy algorithm. The result is 
in Figure 14.81 with larger marker indicating the earlier it is picked. Correspondingly, 
the 50 points in f2 determined by the ERCM for empirical reduced collocation are 
shown in Figure 14.71 

Next, we solve for the RB solutions for randomly selected set of 1, 057 parameter 
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Fig. 4.6. History of convergence for the error estimate (top), the L error (middle) and the 
L°° error (bottom)of the RBM solutions for the anisotropic wavespeed simulation. On the left are 
for the least squares reduced collocation method, and the empirical reduced collocation results are on 
the right. 



values and compute the maximum of the errors for all selected between the reduced 
solution and the truth approximations. These, together with the maximum of the 
error estimate are plotted in Figure l4~5l We clearly see exponential convergence in all 
cases for both methods. 

4.4. Computation time of the reduced solver. In this section, we present 
statistics of the computation time for the reduced collocation methods. We present 
in Table I4.ll the offline and online computational time. We normalize the time with 
respect to that for solving truth approximation once. We see that the algorithm 
achieves savings of three orders of magnitude. From these examples, it seems that 
the empirical collocation approach is a little more efficient than the least-squares 
approach. 
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Fig. 4.7. The reduced collocation points selected by the ECM for diffusion problem. 



0.99» ♦ ♦ 



0.5 



-0.5 



-o.gpiA — <t 



0.99 -0.5 





Ml 



♦ 

♦ # 



0.5 0.9: 




-0.99 -0.5 



Fig. 4.8. The parameter values picked by the greedy algorithm for the diffusion equation. Left: 
Least squares. Right: reduced collocation. 



5. Concluding Remarks. In this paper, we propose the first reduced basis 
method for the collocation framework. Two rather different approaches have been 
proposed and tested. They are both Galerkin-free but produce the same fast expo- 
nential convergence and speedup as for the traditional Galerkin approach. In future 
work, we will examine the accuracy and efficiency of our proposed methods for non- 
affine and nonlinear problems. We also plan to study and tailor successive constraint 
method, currently used for computation of the lower bound for the eigenvalues in the 
Galerkin setting Q2l HI HT| . for the collocation setting. It is also very interesting to 
apply the methods to more general collocation methods and to perform a detailed 
numerical comparison between the Galerkin approach and the collocation approaches 
introduced in this paper. 
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from Paris VI University for helpful discussions that led to a deeper understanding 
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Fig. 4.9. History of convergence for the error estimate (top), the £ 2 error (middle) and the L°° 
error (bottom)of the REM solutions for the diffusion problem. On the left are for the least squares 
approach, and the reduced collocation results are on the right. 



Method 


Offline time 


Online time for u^' 


Time for vff 


Anisotropic LSRCM 


1.029 x 10 3 


2.18 x 10" 4 


1 


Anisotropic ERCM 


0.996 x 10 3 


2.62 x 10~ 4 


1 


Diffusion LSRCM 


8.265 x 10 3 


9.71 x 10~ 4 


1 


Diffusion ERCM 


7.730 x 10 3 


10.69 x 10~ 4 


1 



Table 4.1 

Computation times of the methods for the two test problems. 
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